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This paper considers the problem of direct model reference adaptive control when the 
plant-model matching conditions are violated due to abnormal changes in the plant or 
incorrect knowledge of the plant’s mathematical structure. The approach consists of direct 
adaptation of state feedback gains for state tracking, and simultaneous estimation of the 
plant-model mismatch. Because of the mismatch, the plant can no longer track the state 
of the original reference model, but may be able to track a new reference model that 
still provides satisfactory performance. The reference model is updated if the estimated 
plant-model mismatch exceeds a bound that is determined via robust stability and/or 
performance criteria. The resulting controller is a hybrid direct-indirect adaptive controller 
that offers asymptotic state tracking in the presence of plant-model mismatch as well as 
parameter deviations. 


I. Introduction 

Adaptive control methodologies provide mechanisms that adjust a controller for a system under para- 
metric, structural, and environmental uncertainties to achieve both stability and tracking. Direct model 
reference adaptive control (MR AC) has been known as an effective method for state or output tracking. In 
particular, the ‘state feedback- for-state-tracking (SFST)’ adaptive architecture has the advantages of rela- 
tively simple implementation and effective state tracking in the presence of parameter uncertainties as well 
as actuator failures [1, 2, 3], However, to ensure stability and asymptotic state tracking, the SFST control 
law requires rather stringent plant-model matching conditions to be satisfied. The reference model design 
is usually based on the nominal model of the plant, and incorporates the desired closed-loop performance 
characteristics. Thus the nominal plant satisfies the matching conditions. In reality, however, the actual 
plant parameters differ from the nominal values, because of modeling errors, uncertainties, and parameter 
variation. If these differences are such that the matching conditions are still satisfied, the SFST adaptive 
control law can still ensure stability and state tracking. However, in many cases, the parameter changes 
may alter the mathematical structure of the systems (e.g., due to icing or damage in aircraft), and it may 
no longer be possible to meet the plant-model matching conditions. Since the proofs of stability (signal 
boundedness) and asymptotic tracking assume matching conditions, they are no longer valid in the presence 
of mismatch. Therefore plant-model mismatch has been recognized as an important problem and has been 
considered in the literature [4], [5]. 

If the changes in the plant are moderately small, it may still be possible to follow a slightly perturbed 
reference model that has good stability and performance characteristics. If the changes in the plant are 
large, it would be necessary to redesign the reference model, so that it has satisfactory performance and the 
matching conditions are once again met. In any case, it is important to estimate the pi ant- model mismatch 
while simultaneously performing control gain adaptation and maintaining stability and tracking. With this 
philosophy, this paper presents a direct adaptive control method for simultaneously estimating the plant- 
model mismatch while accomplishing state tracking. The resulting approach is a hybrid direct /indirect 
adaptive approach wherein the reference model is updated when the estimated mismatch exceeds a pre- 
determined threshold. This approach is first developed for the case without failures and then extended 
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to include actuator failures. The primary purpose of the paper is to focus on theoretical aspects and to 
suggest a method for systematically updating the reference model while maintaining signal boundedness and 
asymptotic tracking. 

The paper is organized as follows. Section II develops an adaptive control scheme for the case when there 
are no faults, but unmatchable structural changes occur in the system- and input- matrices of the plant. 
Section III extends the adaptive scheme to the case when multiple actuator failures can occur in addition to 
unmatchable uncertainties. Simulation results are presented in Section IV to demonstrate the methods, and 
Sections V and VI include some discussion and concluding remarks. 


II. Adaptive Control with Model Update- No Faults 

We will focus on linear time- invariant systems (plant) described by: 

x(t) = (A 0 + 5a)x(t) -J- (jBq 5b)u(t ), (1) 

where Ao, 5a € R nxn , Bo, 5b £ R nxrn , x(t) £ R n , and u(t) £ R m . Ao Bo represent the nominal values 
of the system parameters, and 5a, 5b represent unknown parameter deviations, which are assumed to be 
constant. 

The control objective is to design an adaptive state feedback control signal u(t) £ R 171 to be applied to 
all m of the actuators so that the plant’s state vector tracks the state vector of a reference model given by: 

^m(^) = A m X m (t) “b B m r(t), (2) 

where x m £ R n is the reference model state vector, A m £ R nxn , B m £ R nxm , and i'(t) £ R mr (1 < m r < m) 
is a bounded reference input, chosen for some desired system behavior. The objective is to design an adaptive 
control law that will ensure closed-loop signal boundedness and asymptotic tracking despite uncertainties, 
i.e., \im t ^oo(x(t) Xm{t)) = 0. 

The nominal system (Ao, Bo) and the reference model are assumed to satisfy the SFST matching condi- 
tions, i.e., there exist gains Ki £ R nxrn , K 2 £ R mxrnr such that 

A m = A 0 + BoK± ; B m = BoK 2 (3) 

The reference model is assumed to capture the desired closed- loop response of the plant. The reference model 
may be designed, for example, using methods such as LQR, H 2 , or H^, based on imperfect knowledge of 
the plant. The gains K\, K 2 designed in this manner are used as initial estimates of the adaptive gains. For 
the adaptive control scheme, only A m and Bo need to be known. 

In applications such as aircraft flight control, because of model errors, damage, or changes such as icing, 
the actual plant, is (Ao + 5a, Bo + 5b), and therefore, the matching conditions may not be satisfied for any 
K l, K 2 . When the matching conditions are violated, stability (signal boundedness) and asymptotic tracking 
are no longer guaranteed. 

As a simple generic example, suppose 



The perturbations 5a 2 \, 5a 22 , and 5b 2 can be compensated perfectly (matched) by some state feedback gains 
Ki, K 2 . However, structural perturbations 5 an, 5ai 2 , and 5bi cannot be matched by state feedback control 
law. Thus we can take 5a and 5b to be the “unmatched” uncertainties, 

8a=( Sa Q n Sa Q 12 ^ ; 8b =( S, £' j (6) 

Returning to the general problem, define the control law as: 

u = KiX + K 2 r ( 7 ) 
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where Ah, Ah denote the (time- varying) estimates of Ah, A 2 . 
The closed-loop plant is given by: 


x — (-do T 5a)x 4- {Bo -f- 5b){K p x 4- Ah?’) 

= (A 0 + Sa)x + Bo (K? x + K 2 r) + B 0 ( K J x + K 2 r ) + Sb(Kf x + K 2 r) 
= (A 0 + B 0 Kf + Sa)x + B 0 K 2 r + B 0 (K^x + K 2 r) + 8b(Kfx + K 2 r) 

= {A m + 5a + 5bK )x + {B m + dbh. 2 )r + Bq{Ki x + K 2 t) 


where K x = Ki - Kn K 2 = K 2 - K 2 . 

To accommodate plant-model mismatch and parameter deviation, modify the reference model as: 


( 8 ) 


x-m — {A m + 5a -f SbK^)x m 4- {B m + SbK 2 )v (9) 

where (5a, 5b denote (time- varying) estimates of 5a and 5b. 

Denote 

AA = 5a + 5bK*\ A B = 5bK 2 (10) 

so that 

Am = Am 4- A A; Bm = B m 4- A B (11) 

which are time- varying matrices. The modified time- varying reference model is 


Xm = AMX m 4 - Bm r 


( 12 ) 


This representation of the reference model indicates that the plant can no longer follow the original reference 
model (2), but can possibly follow the perturbed reference model (12). Therefore, it will be necessary to 
first ensure that the perturbed reference model has acceptable stability and performance characteristics. 
Use of a time- varying reference model, which is a departure from conventional MR AC, was addressed in 
[7], which employed a time- varying Lyapunov function weighting matrix ( P{t )). In the present approach, 
a time-invariant Lyapunov function weighting matrix is used along with a quadratic stability argument to 
ensure stability of the time- varying reference model. This can be accomplished by calculating the permissible 
limits on the estimated perturbations such that the stability and performance will remain satisfactory for all 
(time- varying) perturbations within these limits. Subsequently it will also be necessary to derive adaptive 
laws (for updating Ah, Ah, <5a, 5b) that guarantee that x{t) — > x m (t), and that all signals remain bounded. 


A. Stability and Performance of Perturbed Reference Model 

Am is a time-varying matrix which can be expressed as an affine function of a parameter vector p € R Up 
that lies in a convex polytope S having vertices pb j = 1, . . . n v . For example, Am can be expressed as 

n p 

A M (p{t)) = Am + Pi(t)AMi (13) 

1 

where Am { are constant matrices and pi (t) E [Pi,Pi], (Pi is the ith component of p). In this case S is a 
hyper-rectangular region with n v = 2 n p vertices. Let Am (p* 1 ) denote the value of the reference model system 
matrix at vertex pL Suppose there exist positive definite matrices P = P T , Q = Q T E R nxn , such that 

Am (p J ) T P + PAm{p ] ) < -Q, j = l,...n v (14) 

For a given Q, (14) represents a set of n v linear matrix inequalities (LMIs) in the unknown variable P. In 
view of (14), the Lyapunov inequality 

A M {p{t)) T P + PA M {p(t)) < -Q, j = 1, ...n v 

is satisfied Vp {t) E <S, and the autonomous part of the reference model (i.e., Eq. 12 with r = 0) is exponen- 
tially stable Vp (t) E S with a guaranteed minimum decay rate e~ Xmin ( p 
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Express pi and pi as 

Pi = 06i\ p [ = 08i; i = 1,. ..n p (15) 

where Si, Si are known constants, and Si < 0 < <5*. The problem is to obtain the maximal region S for which 
(14) holds, i.e., find a positive definite symmetric matrix P that maximizes 6 subject to the set of LMIs in 

m 

The estimate of S obtained in this manner is usually conservative. If the parameter variations (p) are 
rate-bounded, less conservative estimates can be obtained. The stability of the reference model depends only 
on 5 A, while SB affects the closed-loop gain; therefore, if SB is reasonably small, the performance of the 
modified reference model would be acceptable. 

Alternatively, instead of just quadratic stability, an H 2 or H 0 © performance requirement can be imposed on 
the reference model dynamics, Am, Bm • Such requirements can be formulated as linear matrix inequalities 
at the vertices of a polytope in the parameter space and an estimate of the maximal region S can be 
obtained, thus providing the permissible bounds on the elements of A A. The reference model is updated if 
its parameters approach the polytope boundaries. 

B. Adaptation Laws 

Denote e — x — x m , Eqs. (8) and (9) yield 

e = Amz — Sax — Sbu + Bq{K ± x + K 2 r) (16) 

For simplicity of presentation, we shall first assume that A A remains within the quadratic stability bounds. 
Subsequently in Section IIC we shall present a parameter projection algorithm to ensure that this condition 
is met. We have the following result. 

Theorem 1 For the system given by (1), ( 9 ), the adaptive controller (7) with gain adaptation laws 

Ki = — Tixe T PB 0 

K 2 = -Y 2 B 7 Per T (17) 

and parameter estimation laws 

5a = T a Pex T 

5b = TbPev? (18) 

where Ti,T 2 ,F aj Tb are symmetric positive definite matrices , guarantee that all closed-loop signals including 
adaptive gains and parameter estimates are bounded and the tracking error e(t) = x(t ) — x m (t) goes to zero 
as t —> oo. 

Outline of Proof- Define 

n T 171 T 171 T m r rp 

V = e T Pe + J2 5a i r -'Sdi + YsMi T^Sbi+Y^Ku Y^K^ + Yj 1 ^ rj 1 ** ( 19 ) 

111 1 

where the subscript i denotes the z th column of Sa, Sb , Ki, and K 2 ', T a E R nxn , T^ € R nxn , Ti E R nxn , T 2 E 
Rmxm are positive definite and symmetric. Differentiating (19) with respect to t and using (16), (14) as well 
as properties of matrix trace, the following is obtained after simplification: 

V = e T P[A M -^x-Sbu^Bo{Kfx^K 2 r)] 

+2Tr[5a T F-'Sal + 2Tr[6b T T^ 1 Sb] 

+2Tr[FiT 1 - 1 Fi] + 2Tr[K 2 Y^t 2 \ (20) 

In writing the above equation, we have used the fact that K\ — K\ and the property: 

m 

Tr[XRX T }=Y x I Rx i 

1 
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where X £ R rnxn , R £ R nxn and X J denotes the ith row of X. We also have: 

e T P8ax = x T Sa Pe = Tr[5a Pex T } 
e T PSbu = u T Sb Pe = Tr[Sb Peu T ] 
e T PB 0 K 1 T x = Tr[K 1 T xe T PB 0 ] 
e T PB 0 K 2 r = Tr[r T K% B% Pe] = Tr[K 2 B% Per 


Therefore, 

V < -e T Qe-2Tr[fa T {Pex T -r- 1 6a}]-2Tr[6b T {Peu T -r^Sb}} 


(21) 


+2 Tr[I<i { xe 1 PB 0 + T } + 2 Tr[K^ { B ( * Per 1 + T^K 2 }] 


( 22 ) 


The update laws for K\ K 2 , 8a, and 8b, in (17), (18) were chosen to make all terms except the first term in 
the RHS of (22) equal to zero, and 

V < —e T Qe (23) 

That is, V (T) is bounded for all T, and e(t), x(t), Ki, K2, 8a, 8b are all bounded and e(t ) £ L 2 . From (16) 
and closed-loop signal boundedness, we have e £ L°°, therefore lim^oo e(t) = 0. Because e(t) £ L 2 n^°° 

and x(t) £ L°°, K\j, K<ij, 8a, 8b £ L 2 f]L°°. It can be verified that K\j , K 2 j, 8a, 8b £ L°°, therefore 

lim t ^ooK\j(t) = 0; lim t ^ooK 2 j(t) = 0, lim t ^oo8a(t) = 0; lim t ^oo8b(t) = 0. That is, all signals and 
estimates are bounded, and lim t _, 00 (x(i) — x m (£)) = 0. ■ 


Remarks 

• It would be necessary to use projection methods (e.g., [2, 6]) to ensure that the parameter estimates 
remain within the polytope. The reference model is updated when the parameter estimates approach 
the polytope boundaries. The parameter projection is addressed in the next subsection. 

• For the case where only some of the elements of A and B are unmatched, the parameter estimation 
laws can be simplified. For the generic example in (4), the parameters updates laws can be written as 

San = e\T a Pex T e\ 

Sa 12 = e[Y a Pex T £2 (24) 

where Si £ R n denotes a unit vector whose zth element is unity and all other elements are zero. In 
fact, the update laws in Theorem 1 can be easily modified for individual Sa^ s, with individual gains 

IV 

• If sufficient persistent excitation is present, 8a, 8b should converge to zero. 


C. Parameter Projection 

The stability condition in (14) requires that the reference model system matrix Am(P) = A m + 8a + 8bK ^ = 
A m -f XA be a stable matrix for all possible parameter estimates 8a, 8b and K\. From subsection A, the 
stability of Am is assured if A A remains within the bounds obtained from maximizing 0 in (15), denoted 

as (A Aij , A Aij ). The adaptive laws (17)-(18) generating these parameter estimates do not automatically 
guarantee such a property, and they need to be re-designed with parameter projection. 

To implement a parameter projection adaptive law, we need the knowledge of the ranges of the nominal 
parameters to be estimated. In this case, we need to know the lower and upper bounds 8a and 8a\j 
of the components 8aij of 8a = {8aij} £ R nxn , 8b?j and 8b\ ^ of the components 8bij of 8b = {8bij} £ 
R nxm , and and k\^ of the components knj of K\ = {knj} € R nxn , such that for any 8a whose 
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components Saij £ [5a^,8a^j\, any Sb whose components Sbij £ [56?-, 56^-], and any K\ whose components 

knj £ [ki ij,kiij\, the matrix Am = Am + Sa + SbK ± is stable. Such lower and upper bounds are to be 
used in the construction of the parameter projection based adaptive laws. This implies that the parameter 
uncertainties Sa and Sb should stay within the parameter bounds after the adaptive laws are constructed 
with such bounds, in order to ensure the stability of the adaptive laws. Since A A depends on Sa , Sb , and 
Ki, it would be necessary to determine the bounds [ Sa ?•, Sa\j\ , [< Sb ?•, Sb\j], [k^j, such that A A remains 

within the bounds [A Aij , A Aij ]. Investigating appropriate methods for this mapping remains an area of 
future research. 

There are two expected desirable properties of parameter projection: one is to ensure Sa ^ £ [<5a?,£a^.], 
6bij £ [Sb^,5b b i:j ], and k Uj £ [fc? y ,fcj y ] for all t > 0 so that Am is stable, and the other is to maintain 
the desired Lyapunov stability properties established for the case without parameter projection. For this 
purpose, the adaptive laws (17)-(18) are modified as 


Ki 

= —Tixe T PBo + Fi 


k 2 

= -T 2 BlPer T 

(25) 

Sa 

= r a Pex T + F a 


si, 

= V b Peu T + F b 

(26) 


where Fi(t) = {fuj} £ R nxm , F a (t) = {faij} £ R nxn and F b {t) = {fbij} £ R nxrn are projection func- 
tions with their ijth components being fuj, f a ij and fbij, respectively, and the corresponding adapta- 
tion gain matrices are chosen to be Ti = diag{7n, 712 , . . . , 7in}, T a = diag{7 a i, 7 a2 , . . . , 7<m} and T b = 
diag{76i,762, • • • ,7fcn}, with 71* > 0, 7 a i > 0 and 7 bi > 0, for i = 1,2, ...,n, while T 2 = > 0 with 

r 2 € i? mxm , which can be non-diagonal, as parameter projection is not needed for X 2 . 

To specify the projection functions F\(t), F a (t) and F b (t ), we denote 

G\ — — 1l\X6^PBq 

G a = V a Pex T 

G b = r b Peu T (27) 


with their fyth components being gnj, g a ij and gbij, respectively, that is, G\(t) = {gnj} € i? nxm , G a (t) = 
{gaij} € R nxn and G b (t) = {gbij} £ i? nxm , and similarly, Sa = {<5a^-}, Sb = {Sbij} and K\ = {knj}. 

We then choose the initial parameter estimates to satisy 


S<Hj( 0) e [5a“., 5a b j], Sbij( 0) £ [Sb^,Sb b tJ }, k Uj (0) £ [fciy.fcfy] 


and set the projection function components as 

1 ° 

1 —giij(f) 
0 


faijif) — \ 


fbij(t) 


ga ij {t) 

0 


if ij (t) £ (fci^fcii?), or 
if kiij(t) = k^ij, giijit) > 0, or 
if kuj(t) = k\ ip gnj{t) < 0, 
otherwise 

if Saij(t) £ (6afj,8a^j), or 
if 8aij(t) — <5a“ , g aij {t) > 0, or 
if 8aij(t) = 8a b j, g a ij(t) < 0, 
otherwise 

if Sbij(t) £ (Sb?], Sb ij)> or 
if 8bij(t) = Sbij > 9bij(t) > 0, or 
if Sbij(t) = Sb^, g bij (t) < 0, 
otherwise 


9b ij (t) 

for the projection functions F\ (t), F a (t) and F b (t) in the adaptive laws (25)-(26). 


(28) 


(29) 


(30) 


( 31 ) 
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This choice of Fi (t) = {fuj}, F a (t) = { f a ij } and Fb(t) = {fbij} ensures that Sa^ £ [da“-, <5a^-] , 
5bij £ [Sbfj^bF], and k uj £ A:J y ] for all t > 0 so that Am is stable. It is verified below that the choice 

of F\(t ), F a (t) and Fb(t) (whose A:th columns are denoted as fik, f a k and fbk , respectively) also guarantees 
that 

& a k ^a X fak < 0, Sbk T^ l fbk<®,Klk iWifcfCO, (32) 

where Sak , Sbk and K\k are the kth column of Sa = Sa — 5a, 5b = 5b — 5b and K\ = K\ — K\, respectively. 
To see this desired parameter projection property, we write 


5ak T a fak — ^^5aik^f a i faik (33) 

i — 1 

where Sapk is the ith component of Sak • When f a ik = — g a ik ? we have either 5aik(t) = a% k and g a ik (t) < 0, 
or 6aik(t) = a h ik and g a ik(f) > 0, and for both cases, it follows that 

S&ik^fai faik = Ta i {5 a ik 5a%k)g a ik ^ 0 (34) 

rp 

because Saik € [5a^ k ,5a^ k \ is the specified parameter range for Hence, we have: Sak ^a 1 fak < 0, and 

similarly, < 0 and Ki k T fik < 0. 

With the parameter projection functions Fi(t), F a (t) and S&(t), the adaptive laws (25)-(26) introduce the 

, — p p „ ^p 

terms $ a i ^a l fai, i T^fbi and Y17=i ^i 1 fn (which are all non-positive as just shown) 

in the time-derivative V in (22) of the positive definite function V defined in (19), that is, we end up with 

V < —e T Qe, (35) 


so that the desired stability properties of the closed-loop system remain unchanged by parameter projection 
which ensures that Saij £ [5a^,5a\j], Sbij £ [5bfj,6b^\, and kuj £ [kf^, k\ i j], to make Am(£) = A m + 5a + 
SbKf stable as ensured by (14). 


D. Reference Model Updates 

The results in the previous subsections suggest an approach wherein the reference model is updated when 
A A, A B exceed a predetermined threshold. This is expected to occur occasionally as discrete events. 
Assuming that reference model updates occur finite number of times, the adaptive control scheme can be 
implemented as follows 

1. Design a reference model A m , B m based on the initial approximate knowledge of Aq, Bo (denoted by 
Aq, B 0 ), which satisfy the matching conditions (3) 

2. Compute permissible limits on the elements of A A, A B using quadratic stability or performance 
criteria 


3. Apply adaptive control and model update laws (7), (17), (18) 

4. If any elements of A A, A B approach the limits obtained in step (2) (e.g., within 80 per cent), replace 
the system parameter estimates, Ao by Ao + Sa, and So by So + 5b (both constant) and redesign the 
reference model 

5. Set 5 a = 0, 5b = 0 and go to Step 2 


III. Simultaneous Model Mismatch and Actuator Failures 

In addition to model mismatch due to reasons such as modeling errors, icing, and damage, the actuators 
(e.g., control surfaces in aircraft flight control) may fail during the operation. The actuator failures are 
modeled in this paper as 


Uj(t) =Uj, t> tj, j £ {ji,j 2 ,---,jp} Q {1,2,.. . , to} 
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where the failure pattern { Ji , J2 ? . . . , j p }, the failure value Uj (assumed to be constant), and the failure time 
of occurrence tj are all unknown. For example, an aircraft control surface may be locked at some unknown 
fixed value due to hydraulics failure. Let v(t) = [^1,^2, , v rn ] T € R m be the applied (commanded) control 
input vector. In the presence of actuator failures, the actual input vector u to the system can be described 
as 

u(t) = v(t) + g(u — v(t)) = (/ — cr)v(t) + au (37) 

where 

U = [tii , ^2? • • • ■> u m\ 

a = diag{<7i,a 2 ,...,<J m } 
cri = 1 if the ith actuator fails, i.e., Ui = Ui 

<Ji = 0 otherwise (38) 

That is, a is a diagonal matrix whose entries are piecewise step- or zero- functions of time. The components 
of the applied input signal v(t) = [vi(t),V 2 (t ), . . . ,v m (t )] T , which correspond to the failed actuators, cannot 
affect the system dynamics. The actuator failures are uncertain in value, pattern and time of occurrence. 
The objective of the adaptive controller is to synthesize the control signal v(t) so as to ensure the system 
stability and asymptotic tracking regardless of whether (or which) actuators have failed, or the failure values. 
That is, v(t) should be capable of compensating for the failures automatically. 

Direct adaptive control with actuator failures was extensively studied (e.g., [1], [2], wherein different 
adaptive schemes were developed, that included state feedback for state tracking (SFST), state feedback for 
output tracking (SFOT) and output feedback for output tracking (OFOT). While all these adaptive schemes 
require some assumptions in the form of plant-model matching conditions, the SFST scheme requires the 
most stringent matching conditions. However, the SFST scheme has the advantage of simplicity, and is 
well-suited in aircraft flight control applications because the state vector measurements are usually available. 
Therefore it is important to investigate SFST adaptive control that can handle actuator failures in the 
presence of model mismatch. 

We consider the single reference-input case, (i.e., r is a scalar) with multiple redundant similar actuators. 
In this case, the columns of the Bo matrix are parallel to the reference model input matrix b m £ i? n , i.e., 
the ith column of Bo is: 

bi — ^m/ ^ (39) 

for some unknown a* whose sign is assumed to be known. 

The adaptive control input is: 

V — K'i X -|- /u2T -|“ /u3 

where K\ € i? mxn an( j v (j^^ /j 2j It is assumed that at least 

A. Model Mismatch in System Matrix Only 

We shall first consider the case where the system’s “ B ” matrix is known, i.e., 6b = 0, and model mismatch 
occurs only in the “A” matrix. In this case, the closed-loop plant becomes 

x = (Ao + Sa)x + Bo(I — g)v + Boau 

= (Ao + 8a + B 0 (I - a)Kf)x + B 0 (I - a)Kjx + B 0 (I - a)K 2 r 

~\~Bq(I — cr )K 2 r + Bo(I — a )&3 + Bo(I — o )k 2 + Bqctu ( 41 ) 

where K\ = K\ — K\ etc. There can be up to m— 1 actuator failures. We assume that the following matching 
conditions are satisfied for the nominal plant (Ao, Bo) for some K\, &2, and £3, and for all actuator failure 
patterns (cr). 

Ao + Bo (I — g)K\ = A m ; Bq{I — <?)K2 = b m \ Bo(I — G)ks = Bogu (42) 

Therefore (41) can be written as 

x = (A m + 6a)x + b m r + B 0 (I - g)(K 1 x + & 2 r + fc 3 ) (43) 


(40) 

one actuator remains functional. 
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( 44 ) 


To accommodate the plant-model mismatch, the following perturbed reference model is employed: 

im = {Am + 5a)x m -j- 6 m r 

where 6 a denotes the estimate of 5a. Thus the error equation is 

e = Am& — Sax + B 0 {I — cr)(Ki x + k 2 r + fc 3 ) (45) 

where Am — Am + 5a. The following theorem presents the adaptation and parameter estimation laws that 
ensure that eft) — > 0 and all signals remain bounded. As in Section IIB, we shall first assume for simplicity 
of presentation that 5a remains within the quadratic stability limits. This will be ensured by employing 
parameter projection as in section IIC. 

Theorem 2 For the system given by (41), (44), the control law ( 40 ) with gain adaptation laws 


Kn = 

-sgn(aj)TijXe T Pb m 

(46) 

II 

./ S. 

— sgn(aj )~i2j bj n Per 

(47) 

II 

{ ? 

—sgn{otj )7 3 j b^Pe 

(48) 

m and parameter estimation law 



5a 

= r a Pex T 

(49) 


where Tij € R nxn , T a £ i? nxn are p 0S in ve definite and symmetric, and 72 j, 73 j are positive scalars, 
guarantee that all closed-loop signals including adaptive gains and parameter estimates are bounded and the 
tracking error e{t) = x(t) — x m (t) goes to zero as t — > 00 . 

Outline of proof- Eq. (45) can be written as 


e = Am e — 5ax + ^ bj{K^jX -J- k 2 jr -j- fc 3j ) 

HJp 

m 

= A/rfe - Sax + b m ^ (l/aj)(KfjX + k 2 jr + k 3 j) 
j^Jp 


(50) 


where J p = j\, j 2 , • • • ,jp denotes the set of indices corresponding to the p < m — 1 failed actuators. Similar 
to [ 2 ], define 


Then 


in 1 it 

v = e T Pe+J2 + + r- 1 ^ 

3tJ P 1 j ' i= 1 


(51) 


V — 1e^ P\A — Sax + b m { ^ ^ {K^jX + k 2 j r + k 3 j ) / ct ^ } ] 

j 

+2 ^ ——(Kij Kij + k 2 j^f 2 )k 2 j + ^3j7 3 / k 2 j) + ^ 5ai T a 1 5a i 


3tJ P 


i— 1 


-2 e T Qe - 2Tr[5a T {Pex T - I^eSa)] + 2 ^ (— Kli r » A 


H3v 


Q, 


+ 1 1 j ^ 


lot* 


+2 ( k:2 P‘ r,)mr + i ) 


HJ P 3 

Setting the update equations as in the theorem statement, we get 

V < -e T Qe 


(52) 


( 53 ) 


9 of 17 


American Institute of Aeronautics and Astronautics 



The remainder of the proof is similar to that of Theorem 1 and the results in Ref [2]. ■ 

Remark- To ensure that 5a remains within the quadratic stability bounds, parameter projection similar to 
Section IIC needs to be employed. 

The adaptive scheme implementation and model updates are performed as outlined in Section IID. 

The more general case with unmatchable uncertainties in both A and B is considered next. 

B. Model Mismatch in Both System- and Input- Matrices 

When model mismatch occurs in the input matrix (in addition to the system matrix), it is not possible 
to completely mitigate the effect of stuck actuators. However, it is possible to estimate the plant-model 
mismatch in the system- and input- matrices as well as the uncompensated bias term. 

The system equation is: 

x = (Ao H- 5a)x + (Bo 4- 5b)u 

= (A 0 4* 5a)x H- (B 0 + 5b) (I — a)v + (B 0 -1- 5b)au (54) 

where 

u = K x x + k 2 r + k 3 = Kf x + k 2 r -f- k 3 + (Ki x + k 2 r 4- k 3 ) (55) 

Again we assume that the matching conditions (42) hold for the nominal plant (Ao,Bo) for up to m — 1 

failures. Denoting 

5b u = 5b(I — a) 

£ = 5 b u (56) 

(which are piecewise constant) and using the matching conditions (42), (54) can be written as: 

x = ( A m + 5a + 5b u Ki )x 4- ( b m 4- 5b u k 2 )r 4- Bo(/ — (j)[K^x T k 2 r 4- k 3 ] + £ 4- 5b u k 3 (57) 

This plant cannot match the reference model dynamics (2). To accommodate the plant-model mismatch and 
the non- compensable bias input terms (the last two terms in Eq. 57), we modify the reference model as: 

Xm — Am^tti bM r ~b £ + 5b u k 3 (58) 

where 

Am = A 7n + 5a -K 5b u K ^ 

5m — bjji 4“ 5b u k 2 (^^) 

and 5b u are estimates of 5b u . From (54) and (58), we have 

e = Am& — 5ax — 5b u (K^ x + k 2 r + k 3 ) 

4-B(/ — cr) \K^ x 4- k 2 r 4- ^’3] 4- £ — Sb u k 3 (60) 

where £ = £-£; 5b u = 5b u — 5b u . 

The following theorem presents gain adaptation and parameter estimation laws that ensure that all 
signals remain bounded and that e(t) — > 0 as t — > 00 . Note, however, that the modified reference model (58), 
(59) has a bias term and may not represent the ideal closed-loop dynamics, even if Am, 5m are satisfactory 
based on quadratic stability and/or H 2 /H 0 0 performance criteria. This is due to non-compensable mismatch 
resulting from input bias, which no control law can eliminate. 

As in Section III A, we shall first assume for simplicity of presentation that 5 A remains within the 
quadratic stability limits. This will be ensured by employing parameter projection as in section IIC. 

Theorem 3 For the system given by (54), (58), the control law (55) with gain adaptation laws 


Kij = 

— sgn(aj)T i jxe T Pb m 

(61) 

II 

—sgn(otj )')2j er 

(62) 

II 

.( 3? 

-sgnia^jb^Pe 

(63) 
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for j = 1 , . . . , m and parameter estimation laws 


6 a = T a Pex T (64) 

8b u = VbPev T (65) 

k = -T(Pe (66) 

where Tij € R nxn , T a € R nxn Tt, € R nxn , £ R nxn are positive definite and symmetric, and 72 j, 73 j 

are positive scalars, guarantee that all closed-loop signals including adaptive gains and parameter estimates 
are bounded and the tracking error e(t) = x(t) — x m (t) goes to zero as t — > 00. 

Outline of proof- Eq. (60) can be written as 


e = AMe — 6ax — 5b u v + ^ bj (K^x + k 2 jV + k 3 j) + £ 

HJp 

m 

= Am& - Sax - 6b u v + b m '^2 (1 /aj){KjjX + k 2 jV + k 3j ) + £ 


(67) 


where J v = ji,j 2 , • • • ,j p denotes the set of indices corresponding to the p < m — 1 failed actuators. Similar 
to [2], define 


i = l 


V = e T Pe + £ f- (K^T^Kij + k 2 2jl ^ + ~k% 7 ^) + Y Sa? r~ l 6a t 
JtJ, 1 jl 

m 

+ Y 


(68) 


1=1 


Then 


V = 2 e T P[AMe — 6ax - 6b u v + b m { ^ (K^x + k 2 jr + k 3 j)/aj} + £] 

oiJp 


+ 2 Y 6a i r a + 2 Y tKXb'tbui + 2 gfrj'z 

i= 1 i= 1 

-2 e T Qe - 2Tr[6a r {Pex T - T” 1 ^)] - 2 Tr[61? v {Peu T - T^ 1 ^)] + 2£ T (Pe + T^) 


m ,KZ T xe T b m kJt7}K x 


+2 Y ( Al * ^ + 1 I f ^ + 2 y (*3*f + ^ 2 f ^ ) (69) 

* ^ rx ■ rv • < n/ • rv • 


Setting the update equations as in the theorem statement, we get 

V < -e T Qe 


(70) 


The remainder of the proof is similar to that of Theorem 2. ■ 

Remark- To ensure that 5 A remains within the quadratic stability bounds, parameter projection similar to 
Section IIC needs to be employed. 

As stated previously, although x(t) — ► x m (t) as t — > oo, the reference model state vector x m (t) may not 
be satisfactory (even if Am, bM are acceptable) because of the non-compensable bias term (£ + Sb u k 3 ) in 
(58). If the bias term is small, the reference model may be acceptable. 

The adaptive scheme implementation and model updates are performed in a manner similar to Section 

IID. 
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IV. Example 


This section illustrates the algorithm introduced in the paper via an example. The nominal model (Ao, 
B 0 ) is 


Ao = 


0 1 

-1.5 1 


; B 0 = 


(71) 


The unstable nominal model is stabilized by K\ — [—3, — 3] , and the reference model is defined as the 
closed-loop system: 


A m — Aq + BqK\ 


0 1 

-4.5 -2 


j Bn 


(72) 


Suppose the actual system matrix is Ao + 6 a, where 6 a = 

6 b = 0). Since 5b = 0 we need to estimate only 6 a, K\, and K<i . Clearly the matrix Ao 4- 6 a + BoKf will 
not have the same structure as A m for any K\. The algorithm, introduced in previous sections, allows the 
reference model system matrix A m + 6 a + 6 bK[ in Eq. (9) to accommodate the plant-model mismatch, and 
the states of the system to track those of the reference model. 

The first step is to compute the permissible limits on 6 A for quadratic stability of the time-varying 
reference system. This can be accomplished using an LMI formulation as descried in section IIA. The 
maximum permissible variation A A = 5a in Eq. (10) was obtained as 6 au and 612 £ [—0.5465,0.5465]. 
The parameter projection described in Sec IIC was not implemented in this example, and the permissible 
variation threshold was arbitrarily set at 80 percent of the maximum permissible limits, i.e., [-0.4372, 0.4372]. 
The corresponding Lyapunov matrix P in Eq. (14) (with Q = 0, i.e., stability was the only requirement) was 
obtained as 


0.2 

0 


0.2 

0 


, and the input matrix is Bo (that is, 


608.8390 167.7162 
167.7162 132.6987 


The gains T 1 , T 2 , T a , and T& in Eqs. (17)and(18) were selected as 20, 20, [0.3 0; 0 0.1], and [1 0; 0 1], 
respectively. 


A reference input r(t) consisting of a noisy square wave superimposed on a step function was applied 
(Figure 1). Figure 2 shows the tracking performance without adaptation. The tracking errors are on the 
order of 0.1. 


r(t) 


Input 


1 1 

iLl ilk 

> gtL |j|i Udj ik 

WjF Pi 

k jjUI 

^ iff ITT ™ PP 

iV 

p^n 

yj UL 

™ IP P * 

W ™ V 

L__ 


- 


0 5 10 15 20 25 30 35 40 45 50 

Time (s) 


Figure 1. The time history of the reference input r(t) 
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Actual model - reference model 


State 

variables 


Reference model, actual model 




(a) Plant and reference model states 


(b) State tracking error 


Figure 2. Tracking performance with no adaptation (6a = [0.2 0.2; 0 0]) 


Next, the simulation was performed with the adaptive control law. Figure 3 shows the tracking perfor- 
mance with adaptation. It can be seen that the tracking errors are much smaller (by an order of magnitude) 
and remain < 10 -3 for t > 20. Figure 4 shows the parameter estimates 6 an and 5a 12 . It can be seen that 


State 

variables 



(a) Plant and reference model states 


(b) State tracking error 


Figure 3. Tracking performance with adaptation (8a = [0.2 0.2; 0 0]) 

the estimates approach within 5 per cent of the true parameter values in less than 25 seconds. Since the 
parameter estimates remained within the permissible limits, it was not necessary to update/redesign the 
reference model. However, at t = 25 sec, it would be desirable to redesign the reference model based on the 
updated nominal model, in order to obtain a better response. 
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Estimation of 8 a 



Figure 4. Estimates of San and Sa \2 for Sa = [0.2 0.2; 0 0] 


The mismatch matrix was next increased to: 6 a = 


0.2 

0 


0.4 

0 


Figure 5 shows the parameter estimates, 


which approach the true values, but at a slower rate (within 10 per cent in about 100 sec). The state 
tracking error (not shown), however, approaches zero much faster., similar to the previous case. Again, the 
estimates Jan and Jan remained within the permissible bounds, hence reference model redesign/update 
was not necessary, although such an update would enhance the system performance. 


Estimation of 6 a 



Figure 5. Estimates of <5an and Sa\2 for Sa = [0.2 0.4; 0 0] 


The mismatch matrix was next increased further to 6a 


0.6 0.5 

0 0 


In this case, the parameter estimate 


6a\\ exceeded the threshold which was set at ±0.4372 (80 per cent of maximum permissible values), at 
approximately 5 sec and the reference model was redesigned using Ao^ new ^ = A$ ± Ja, with K i, K 2 reset 

at new values that accomplish plant-model matching. The new permissible bounds on Jan, Jan were 
calculated. These bounds were exceeded at approximately 12.5 sec, when the reference model was once 
again redesigned. The reference input was a chirp signal, which was found to be more effective than the step 
and square wave used previously, probably because of the larger magnitude of the mismatch. Figure 6 shows 
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the system states and the reference model-states as well as the state tracking errors, with no adaptation, 
and Figure 7 shows the results with adaptation. The state tracking performance with adaptive control is 
very good. 


Nonadaptive: reference model, actual model 


State 
variables 



Nonadaptive: actual model - reference model 


e(t) 



(a) Plant and reference model states 


(b) State tracking error 


Figure 6. Tracking performance with no adaptation (5a = [0.6 0.5; 0 0]) 


State 

variables 


Reference model, actual model (witfi adaptive control) 



Actual model - reference model (with adaptive control) 


e(t) 



(a) Plant and reference model states 


(b) State tracking error 


Figure 7. Tracking performance with adaptation (5a = [0.6 0.5; 0 0]) 


As seen in Figure 8, the parameter estimates appear to approach their true values (relative to the most 
recent plant estimate) in about 50 sec. 


V. Discussion 

The focus of the paper has been on theoretical aspects of how the plant-model mismatch can be es- 
timated (in the presence or absence of actuator failures) and how the reference model can be changed to 
accommodate the mismatch while ensuring stability and asymptotic tracking. From the limited numerical 
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Estimation of 8 a 



Figure 8. Estimation of <5an and Sa \2 for 8a = [0.6 0.5; 0 0] 


results obtained, the simultaneous mismatch estimation and gain adaptation can work well for moderate 
magnitudes of mismatch. The state tracking error approaches zero fairly quickly, although the mismatch 
estimates approach their steady state values at a slower rate. The mismatch estimates can exhibit a large 
overshoot initially, which could trigger a redesign of the reference model (because of exceeding the permis- 
sible bounds). The parameter estimates approach their true values; however, based on several simulation 
runs, the type, the magnitude, and the frequency content of the persistent excitation signal are important 
for accomplishing convergence of the mismatch estimates to their true values. If the persistent excitation 
signal is not sufficiently rich, the mismatch estimates may approach some constants that are not their true 
values. Design of appropriate persistent excitation signals, that enable rapid and accurate mismatch esti- 
mation without causing unacceptable disturbance in the system, remains an area of future research. In all 
cases, the state tracking performance was very good and the tracking error quickly approached zero. Further 
simulation studies are continuing for more realistic systems in order to assess the method and to investigate 
improvements. 

It would be desirable to avoid large over /undershoots in the mismatch parameter estimates, possibly 
by using techniques such as sigma modification. Also, the performance of the adaptive scheme depends 
significantly on the choice of the adaptation weighting parameters; therefore it would be of interest to 
investigate systematic methods for selecting these parameters. 

One issue that needs to be addressed is parametrization of the plant- model mismatch. It is straightforward 
to uniquely parametrize the mismatch when the nominal system is in a canonical form. However, for general 
system structures, the mismatch 5a, 5b would be fully populated matrices. Such a mismatch structure 
would result in overparametrization. Therefore it would be desirable to investigate canonical structures of 
plant-model mismatch. 

The method used to ensure stability of the reference model was based on quadratic stability, which 
is usually conservative. In particular, the number of (simultaneous) quadratic stability LMIs grows expo- 
nentially with the number of mismatch parameters, which can result in overly conservative bounds on the 
mismatch. In addition, the LMI solution and reference model redesign are performed in real time, which can 
be computationally challenging. 

Finally, it is desirable to investigate application of the method to realistic higher order examples with 
several mismatch parameters, and in the presence of actuator failures as described in Section III. 

VI. Concluding Remarks 

Direct adaptive control for state tracking using state feedback has been known to be a promising technique 
for control of uncertain systems. However, it requires rather stringent matching conditions on the plant and 
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the reference model which may be violated due to modeling errors and plant changes such as dynamics changes 
caused by damage and icing in aircraft. To address this issue, this paper presented a new adaptive control 
approach for state tracking with simultaneous plant-model mismatch estimation that provides a method for 
changing the reference model when the plant changes are large. In particular, when the estimated plant- 
model mismatch exceeds pre-determined bounds, the reference model is redesigned so that the matching 
conditions are re-established and the overall performance is satisfactory. The method was also extended 
to the case with actuator failures. Results of application to an example problem indicate that accurate 
mismatch estimation and satisfactory tracking performance can be obtained in the presence of plant-model 
mismatch. Further investigation is in progress to evaluate and refine the method. 
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